L1 penalized LAD estimator for high dimensional linear regression
نویسنده
چکیده
In this paper, the high-dimensional sparse linear regression model is considered, where the overall number of variables is larger than the number of observations. We investigate the L1 penalized least absolute deviation method. Different from most of other methods, the L1 penalized LAD method does not need any knowledge of standard deviation of the noises or any moment assumptions of the noises. Our analysis shows that the method achieves near oracle performance, i.e. with large probability, the L2 norm of the estimation error is of order O( √ k log p/n). The result is true for a wide range of noise distributions, even for the Cauchy distribution. Numerical results are also presented.
منابع مشابه
The L [ subscript 1 ] penalized LAD estimator for high dimensional linear regression
In this paper, the high-dimensional sparse linear regression model is considered, where the overall number of variables is larger than the number of observations. We investigate the L1 penalized least absolute deviation method. Different from most of other methods, the L1 penalized LAD method does not need any knowledge of standard deviation of the noises or any moment assumptions of the noises...
متن کاملThe L1L1 penalized LAD estimator for high dimensional linear regression
In this paper, the high-dimensional sparse linear regression model is considered, where the overall number of variables is larger than the number of observations. We investigate the L1 penalized least absolute deviation method. Different from most of other methods, the L1 penalized LAD method does not need any knowledge of standard deviation of the noises or any moment assumptions of the noises...
متن کاملComparison of Ordinal Response Modeling Methods like Decision Trees, Ordinal Forest and L1 Penalized Continuation Ratio Regression in High Dimensional Data
Background: Response variables in most medical and health-related research have an ordinal nature. Conventional modeling methods assume predictor variables to be independent, and consider a large number of samples (n) compared to the number of covariates (p). Therefore, it is not possible to use conventional models for high dimensional genetic data in which p > n. The present study compared th...
متن کاملAdaptive penalized quantile regression for high dimensional data
We propose a new adaptive L1 penalized quantile regression estimator for highdimensional sparse regression models with heterogeneous error sequences. We show that under weaker conditions compared with alternative procedures, the adaptive L1 quantile regression selects the true underlying model with probability converging to one, and the unique estimates of nonzero coefficients it provides have ...
متن کاملLinear Regression with a Large Number of Weak Instruments using a Post-l1-Penalized Estimator
This paper proposes a new two stage least squares (2SLS) estimator which is consistent and asymptotically normal in the presence of many weak instruments and heteroskedasticity. The first stage consists of two components: first, an adaptive absolute shrinkage and selection operator (LASSO) that selects the instruments and second, an OLS regression with the selected regressors. This procedure is...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012